Goto

Collaborating Authors

 landing site


Vision-Guided Optic Flow Navigation for Small Lunar Missions

Cowan, Sean, Fanti, Pietro, Williams, Leon B. S., Yam, Chit Hong, Asakuma, Kaneyasu, Nada, Yuichiro, Izzo, Dario

arXiv.org Artificial Intelligence

Private lunar missions are faced with the challenge of robust autonomous navigation while operating under stringent constraints on mass, power, and computational resources. This work proposes a motion-field inversion framework that uses optical flow and rangefinder-based depth estimation as a lightweight CPU-based solution for egomotion estimation during lunar descent. We extend classical optical flow formulations by integrating them with depth modeling strategies tailored to the geometry for lunar/planetary approach, descent, and landing--specifically, planar and spherical terrain approximations parameterized by a laser rangefinder. Motion field inversion is performed through a least-squares framework, using sparse optical flow features extracted via the pyramidal Lucas-Kanade algorithm. We verify our approach using synthetically generated lunar images over the challenging terrain of the lunar south pole, using CPU budgets compatible with small lunar landers. The results demonstrate accurate velocity estimation from approach to landing, with sub-10% error for complex terrain and on the order of 1% for more typical terrain, as well as performances suitable for real-time applications. This framework shows promise for enabling robust, lightweight on-board navigation for small lunar missions.


Hybrid Autonomy Framework for a Future Mars Science Helicopter

Di Pierno, Luca, Hewitt, Robert, Weiss, Stephan, Brockers, Roland

arXiv.org Artificial Intelligence

-- Autonomous aerial vehicles, such as NASA's Ingenuity, enable rapid planetary surface exploration beyond the reach of ground-based robots. Thus, NASA is studying a Mars Science Helicopter (MSH), an advanced concept capable of performing long-range science missions and autonomously navigating challenging Martian terrain. Given significant Earth-Mars communication delays and mission complexity, an advanced autonomy framework is required to ensure safe and efficient operation by continuously adapting behavior based on mission objectives and real-time conditions, without human intervention. This study presents a deterministic high-level control framework for aerial exploration, integrating a Finite State Machine (FSM) with Behavior Trees (BTs) to achieve a scalable, robust, and computationally efficient autonomy solution for critical scenarios like deep space exploration. In this paper we outline key capabilities of a possible MSH and detail the FSM-BT hybrid autonomy framework which orchestrates them to achieve the desired objectives. These inputs trigger state transitions or dynamically adjust behavior execution, enabling reactive and context-aware responses. The framework is middleware-agnostic, supporting integration with systems like F-Prime and extending beyond aerial robotics. Aerial vehicles have revolutionized planetary exploration by enabling access to scientifically valuable but hazardous terrain beyond the reach of ground-based robots. NASA's Ingenuity Mars helicopter demonstrated the feasibility of controlled flight on Mars, completing 72 successful flights despite the planet's thin atmosphere [1], [2]. However, Ingenuity was a technology demonstrator, designed primarily to validate powered flight rather than autonomously execute complex scientific missions.


Scan, Materialize, Simulate: A Generalizable Framework for Physically Grounded Robot Planning

Elhafsi, Amine, Morton, Daniel, Pavone, Marco

arXiv.org Artificial Intelligence

Autonomous robots must reason about the physical consequences of their actions to operate effectively in unstructured, real-world environments. We present Scan, Materialize, Simulate (SMS), a unified framework that combines 3D Gaussian Splatting for accurate scene reconstruction, visual foundation models for semantic segmentation, vision-language models for material property inference, and physics simulation for reliable prediction of action outcomes. By integrating these components, SMS enables generalizable physical reasoning and object-centric planning without the need to re-learn foundational physical dynamics. We empirically validate SMS in a billiards-inspired manipulation task and a challenging quadrotor landing scenario, demonstrating robust performance on both simulated domain transfer and real-world experiments. Our results highlight the potential of bridging differentiable rendering for scene reconstruction, foundation models for semantic understanding, and physics-based simulation to achieve physically grounded robot planning across diverse settings.


Toward Appearance-based Autonomous Landing Site Identification for Multirotor Drones in Unstructured Environments

Springer, Joshua, Guðmundsson, Gylfi Þór, Kyas, Marcel

arXiv.org Artificial Intelligence

A remaining challenge in multirotor drone flight is the autonomous identification of viable landing sites in unstructured environments. One approach to solve this problem is to create lightweight, appearance-based terrain classifiers that can segment a drone's RGB images into safe and unsafe regions. However, such classifiers require data sets of images and masks that can be prohibitively expensive to create. We propose a pipeline to automatically generate synthetic data sets to train these classifiers, leveraging modern drones' ability to survey terrain automatically and the ability to automatically calculate landing safety masks from terrain models derived from such surveys. We then train a U-Net on the synthetic data set, test it on real-world data for validation, and demonstrate it on our drone platform in real-time.


Structure-Invariant Range-Visual-Inertial Odometry

Alberico, Ivan, Delaune, Jeff, Cioffi, Giovanni, Scaramuzza, Davide

arXiv.org Artificial Intelligence

The Mars Science Helicopter (MSH) mission aims to deploy the next generation of unmanned helicopters on Mars, targeting landing sites in highly irregular terrain such as Valles Marineris, the largest canyons in the Solar system with elevation variances of up to 8000 meters. Unlike its predecessor, the Mars 2020 mission, which relied on a state estimation system assuming planar terrain, MSH requires a novel approach due to the complex topography of the landing site. This work introduces a novel range-visual-inertial odometry system tailored for the unique challenges of the MSH mission. Our system extends the state-of-the-art xVIO framework by fusing consistent range information with visual and inertial measurements, preventing metric scale drift in the absence of visual-inertial excitation (mono camera and constant velocity descent), and enabling landing on any terrain structure, without requiring any planar terrain assumption. Through extensive testing in image-based simulations using actual terrain structure and textures collected in Mars orbit, we demonstrate that our range-VIO approach estimates terrain-relative velocity meeting the stringent mission requirements, and outperforming existing methods.


Fuel-Optimal Powered Descent Guidance for Hazardous Terrain

Basar, Sheikh Zeeshan, Ghosh, Satadal

arXiv.org Artificial Intelligence

Future interplanetary missions will carry more and more sensitive equipment critical for setting up bases for crewed missions. The ability to manoeuvre around hazardous terrain thus becomes a critical mission aspect. However, large diverts and manoeuvres consume a significant amount of fuel, leading to less fuel remaining for emergencies or return missions. Thus, requiring more fuel to be carried onboard. This work presents fuel-optimal guidance to avoid hazardous terrain and safely land at the desired location. We approximate the hazardous terrain as step-shaped polygons and define barriers around the terrain. Using an augmented cost functional, fuel-optimal guidance command, which avoids the terrain, is derived. The results are validated using computer simulations and tested against many initial conditions to prove their effectiveness.


India's Lander Touches Down on the Moon. Russia's Has Crashed

WIRED

Today, India's Chandrayaan-3 became the first spacecraft to successfully land near the lunar south pole, and India became the fourth country to make a soft landing anywhere on lunar soil, following the former Soviet Union, the United States, and China. The robotic vehicle touched down at 8:33 Eastern time, nearly six weeks after its launch. The craft includes a four-legged lander and a small rover to study the lunar regolith and look for signs of water ice during a two-week mission. On August 20, the craft malfunctioned and appears to have crashed while preparing for a landing planned for the next day. Roscosmos, Russia's space agency, intended to deploy Luna-25 for a year-long mission near the Boguslavsky impact crater, where its eight scientific instruments would also have examined properties of the regolith and pockets of water ice.


HALO: Hazard-Aware Landing Optimization for Autonomous Systems

Hayner, Christopher R., Buckner, Samuel C., Broyles, Daniel, Madewell, Evelyn, Leung, Karen, Acikmese, Behcet

arXiv.org Artificial Intelligence

With autonomous aerial vehicles enacting safety-critical missions, such as the Mars Science Laboratory Curiosity rover's landing on Mars, the tasks of automatically identifying and reasoning about potentially hazardous landing sites is paramount. This paper presents a coupled perception-planning solution which addresses the hazard detection, optimal landing trajectory generation, and contingency planning challenges encountered when landing in uncertain environments. Specifically, we develop and combine two novel algorithms, Hazard-Aware Landing Site Selection (HALSS) and Adaptive Deferred-Decision Trajectory Optimization (Adaptive-DDTO), to address the perception and planning challenges, respectively. The HALSS framework processes point cloud information to identify feasible safe landing zones, while Adaptive-DDTO is a multi-target contingency planner that adaptively replans as new perception information is received. We demonstrate the efficacy of our approach using a simulated Martian environment and show that our coupled perception-planning method achieves greater landing success whilst being more fuel efficient compared to a nonadaptive DDTO approach.


Investigation of risk-aware MDP and POMDP contingency management autonomy for UAS

Sharma, Prashin, Kraske, Benjamin, Kim, Joseph, Laouar, Zakariya, Sunberg, Zachary, Atkins, Ella

arXiv.org Artificial Intelligence

Unmanned aircraft systems (UAS) are being increasingly adopted for various applications. The risk UAS poses to people and property must be kept to acceptable levels. This paper proposes risk-aware contingency management autonomy to prevent an accident in the event of component malfunction, specifically propulsion unit failure and/or battery degradation. The proposed autonomy is modeled as a Markov Decision Process (MDP) whose solution is a contingency management policy that appropriately executes emergency landing, flight termination or continuation of planned flight actions. Motivated by the potential for errors in fault/failure indicators, partial observability of the MDP state space is investigated. The performance of optimal policies is analyzed over varying observability conditions in a high-fidelity simulator. Results indicate that both partially observable MDP (POMDP) and maximum a posteriori MDP policies performed similarly over different state observability criteria, given the nearly deterministic state transition model.


Autonomous Drone Landing: Marked Landing Pads and Solidified Lava Flows

Springer, Joshua, Kyas, Marcel

arXiv.org Artificial Intelligence

Landing is the most challenging and risky aspect of multirotor drone flight, and only simple landing methods exist for autonomous drones. We explore methods for autonomous drone landing in two scenarios. In the first scenario, we examine methods for landing on known landing pads using fiducial markers and a gimbal-mounted monocular camera. This method has potential in drone applications where a drone must land more accurately than GPS can provide (e.g.~package delivery in an urban canyon). We expand on previous methods by actuating the drone's camera to track the marker over time, and we address the complexities of pose estimation caused by fiducial marker orientation ambiguity. In the second scenario, and in collaboration with the RAVEN project, we explore methods for landing on solidified lava flows in Iceland, which serves as an analog environment for Mars and provides insight into the effectiveness of drone-rover exploration teams. Our drone uses a depth camera to visualize the terrain, and we are developing methods to analyze the terrain data for viable landing sites in real time with minimal sensors and external infrastructure requirements, so that the solution does not heavily influence the drone's behavior, mission structure, or operational environments.